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ABSTRACT 


This  thesis  is  an  accuracy  study  of  three  empirical 
series  system  lower  confidence  limit  procedures.  Computer 
simulations  were  used  to  compare  the  accuracy  of  the  pro- 
cedures using  the  same  set  of  data  with  500  replications 
for  each  case.  Modifications  were  then  made  to  improve  the 
accuracy  of  the  Log-Gamma  method. 

The  systems  simulated  had  reliabilities  ranging  from  .6 
to  .95.  They  were  composed  of  four,  fifteen,  or  forty  com- 
ponents, and  had  component  sample  sizes  of  ten,  twenty,  or 
fifty. 

The  Lieberman-Ross  method  was  accurate  but  had  high 
variance.  The  Log-Gamma  method  was  conservative  with  small 
sample  sizes,  but  became  more  accurate  with  increased  test- 
ing. Randomization  of  the  Log-Gamma  method  was  the  most 

* 

successful  of  the  modifications  attempted. 
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I.  INTRODUCTION 


There  exist  many  lower  confidence  limit  procedures  for 
series  system  reliability  which  are  based  on  component  data. 
All  of  them  are  approximate  in  one  way  or  another  for  real- 
istic testing  situations.  Two  such  procedures  are  the 
Lieberman-Ross  (LR)  procedure  and  the  Log-Gamma  (LG)  proce- 
dure. The  LR  lower  confidence  limit  (LCL)  is  based  on 
operating  time  data  and  assumes  time  to  failure  is  expo- 
nentially distributed.  The  LG  LCL  is  based  on  attributes 
data  and  thus  is  non-pararaetric.  A modification  of  the  LG 
procedure,  called  the  Continuous  Log-Gamma  (CLG)  procedure, 
is  based  on  time  data  and  assumes  an  exponential  failure 
distribution. 

In  this  thesis  the  accuracy  of  the  LR,  LG,  and  CLG  pro- 
cedures are  compared  when  data  is  generated  from  the  expo- 
nential distribution  for  serial  systems  with  four,  fifteen, 
and  forty  components.  Sample  sizes  are  generated  in  a 
manner  which  is  somewhat  representative  of  data  accumulated 
from  missile  flight  tests. 

The  accuracy  analysis  was  extended  to  the  case  where 
all  components  were  assumed  to  have  a Weibull  distribution 
with  increasing  and  decreasing  failure  rates. 

In  all  cases,  the  LR  and  LG  procedures  were  slightly 
modified  from  their  more  common  forms  in  order  to  accommodate 
zero  failures  on  all  components. 
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Since  the  component  teat  data  was  generated  using  the 
exponential  assumption,  the  LR  method  enjoyed  an  advantage 
over  the  LG  method  in  that  continuous  LCL  procedures  are 
exact  while  discrete  LCL  procedures  are  not.  All  discrete 
lOO(l-a)^  LCL's,  Rg  L(a)»  ^or  sys‘tem  reliability  Rg  have 
the  property  that 

p[RS,I,(a)  ^ Ra]  2 1 - “ 

For  some  values  of  R , this  probability  is  100$.  Thus  dis- 

S 

Crete  LCL's  will  usually  be  lower  in  value  than  a continu > 
ous  LCL  using  the  same  set  of  data.  Discrete  LCL's  have 
the  advantage,  however,  of  remaining  the  same  regardless 
of  the  underlying  distribution.  Consequently,  they  are 
not  susceptible  to  inaccuracies  due  to  a mistaken  assump- 
tion about  the  probability  distribution  of  the  operating 
component  time  data  as  are  continuous  procedures.  That  is, 

A 

if  Rg  is  discrete 

P^S,L(a)  - Rs^  - 1 " a 

regardless  of  the  probability  distribution  of  the  component 

A* 

time  data,  whereas  if  Rg  is  continuous 

P[RS,L(<x)  ^ R,3  * 1-a 

provided  the  required  assumption  made  about  the  probability 
distribution  of  the  component  failure  data  is  correct. 

Even  if  the  assumed  continuous  distribution  is  not  correct, 
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however,  RstL(a)  may  be  reasonably  accurate,  depend- 

ing upon  the  true  component  failure  distribution.  Of  course 
these  distributions  are  never  known. 

Finally,  continuous  LCL's  required  more  refined  data 
than  discrete  LCL's,  Discrete  LCL  procedures  can  be  used 
if  continuous  time  data  is  available  but  continuous  LCL 
procedures  cannot  be  employed  with  only  attributes  data. 
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II.  DESCRIPTION  OF  THE  METHODS 


A.  THE  LOG -GAMMA  METHOD 

The  following  development  is  a summary  of  that  given 
in  Ref.  1.  The  Log-Gamma  (LG)  method  requires  only  attri- 
butes data,  and  assumes  nothing  about  the  failure  distribu- 
tion. It  is  designed  for  independent  series  systems,  does 
not  require  equal  component  sample  sizes,  and  is  approxi- 
mate. A modification  of  the  LG  method  for  systems  composed 
of  a mixture  of  series  and  parallel-connected  components 
was  explored  by  Ref.  2, 

Suppose  a system  consists  of  K components  in  series, 
and  that  copies  of  component  i are  put  on  test  and  oper- 
ated until  failure  or  completion  of  mission,  whichever 
occurs  first.  Denote  F^  as  the  number  of  components  of 
type  i that  did  not  complete  the  mission.  Then  the  maximum 
likelihood  estimate  for  system  reliability  is 
a K A 

Rg=  IT  R*  (2.1) 

3 i=l  1 

N.  - F. 

where  R^  = — XN^  (2.2) 

In  the  LG  procedure  the  method  of  moments  is  used  to 

A 

fit  the  random  variable  -lnR_  with  the  two-parameter  gamma 
distribution.  The  gamma  is  then  transformed  into  a chi 
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square  distribution,  about  which  probability  statements 
are  made  and  a lower  confidence  limit  (LCL)  obtained. 
That  is,  define 


S = -InR  = - 


_ = -lnlf  R.  = - I ln(l-Q. ) 
3 i=l  1 i=l  1 

K 9 K 

« £ (Q.*£Qf)  = £ T. 
i=l  1 1 i=l  1 

A 

An  unbiased  estimator  for  is 

A A 5^ 

Ti  =AiQi  + Bi  2 


2N.-3 

Where  Ai  = 2Ni  - 2 


'i 

N, 


Bi  =^TtT 


and 


- Fi 
Qi  = Ni 


i=l,K 


(2.3) 

(See  Appendix  A) 

(2.4) 


(2.5) 

(2.6) 

(2.7) 

(See  Appendix  B) 


(2.8) 


That  T^  is  unbiased  is  important,  because 

a K A 
S = £ T. 
i=l  1 

is  used  as  an  estimator  for  S,  thereby  accumulating  any 

A 

bias  present  in  the  T^.  An  approximate  value  for  the  vari- 

A 

ance  of  S is 

K 


Var(S)  = £ Var(T.] 

i=l  1 


* £ 


K II 


A Ni 


(2.9) 
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Appendix  C derives  the  actual  variance  of  and  shows 
equation  (2,9)  is  an  excellent  approximation  for  Var(S). 

A 

Next,  fit  S with  a gamma  distribution.  The  probability 
distribution  of  S is  then  given  by  the  density  function 


fA(x»r,  6)  — r-xr_1  Exp(-x/e) 

S /*(  r)6r 


It  follows  that 

E(S)  = re 
Var(S)  = re2 

A 

Since  S is  unbiased, 

E(S)  = S 

K 


x > 0,  r>  0 

e>  o 


(2.10) 


(2.11) 

(’-.12) 


(2.13) 


Solving  equations  (2.9).  (2.11),  (2.12),  and  (2.13) 
simultaneously  gives  the  shape  parameter 


and  the  scale  parameter 


e 


Thus,  r can  be  estimated  by 


A 

r 


(2.14) 


(2.15) 


(2.16) 
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Since  & is  distributed  gamma  (r#0),  is  distributed  . 
Then 

1 - « - P<-4->  9[f. a#2r)  (2.17) 

- r(2ri>re  -^.at2r) 

A 

Since  S is  unbiased 
E(S)  = S 
= r0 


= -ln*s 

Equation  (2.1?)  becomes 

A <v2 


1 -a  = P(2rS>-lnRa  •^1_ctf2r) 


- P(Exi 


A 

-2rS 


HU 


2r . 


(2.18) 


(2.19) 


Therefore, 

is 


the  LG  100(l-a)£  LCL  for  system  reliability  Rc 


S,L(a) 


= Ext 


A A 

-2rS 

^1-a. 


(2.20) 


_ A 

2r, 


To  preclude  usage  of  non-integer  degrees  of  freedom,  the 
approximation 

~ 

1- 

is  used  in  equation  (2,20),  where  [2r]  denotes  the  smallest 
integer  greater  than  or  equal  to  2r.  Approximation  (2.21) 
was  shown  to  have  little  effect  on  the  LG  procedure  accur- 
acy [Ref.  2,  p.  13].  However,  it  may  produce  monotonicity 
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problems  under  certain  circumstances  (discussed  in  Chapter 
V),  Thus,  the  100(l-a)£  LCL  becomes 


‘2-22) 

M-a,  [2rJ 

and  was  the  LG  LCL  initially  simulated  by  this  study  (Chap- 
ter IV). 


B.  THE  CONTINUOUS  LOG-GAMMA  METHOD 


The  Continuous  Log-Gamma  (CLG)  method  is  developed  in 
detail  by  Ref.  3»  pages  C-l  through  C-20  (as  the  "Classi- 
cal" method).  It  differs  from  the  LG  method  only  in  that 
it  requires  component  time  data  and  assumes  exponential 
failures. 

The  derivation  of  the  CLG  procedure  is  analogous  to 
that  of  the  LG  procedure,  and  is  outlined  as  follows. 

Define 


Z a -lnRg 
K 

= -in  IT  R, 
i=l  1 


(2.23) 


Using  time  data  and  assuming  exponentiality,  can  be  esti- 
mated by 

= 1=1 -K 

where  Tsum^  is  the  accumulated  operating  time  of  the  ith 
component.  Then  Z is  estimated  by 


A 

Z 


K 

E 

i=l 


Tsum. 


(2.24) 
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and 


(2.26) 

(2.2?) 

(2.28) 


Var(Z)  = LX 

where  L is  the  shape  parameter  and  X is  the  scale  parameter. 
The  resultant  CLG  lOO(l-a)*  LCL  is 


*S,L(a)  = Exp(v22^  A") 
M-a,2L 


with 


A A 

L =i  £ 


V’ 


F. 

l 


Tsum. 


To  preclude  non-integer  degrees  of  freedom 


(2.29) 


(2.30) 


D ’ V / - fell]  Z 

RS,L(a)  = Expfe 


$1-cl,[2l]. 


(2.31) 


where  [2l}  is  the  smallest  integer  greater  than  or  equal 
to  2L. 

C.  THE  LIEBERMAN-ROSS  METHOD 
1.  The  Original  Procedure 

The  Lieberman-Ross  (LR)  method  was  designed  as  an 
exact  lower  confidence  limit  (LCL)  procedure  for  independ- 
ent series  systems  (see  Ref.  k) . It  requires  component 
times  between  successive  failures  from  an  assumed  exponen- 
tial failure  distribution,  and  does  not  require  equal  com- 
ponent sample  sizes. 
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The  test  plan  may  "be  described  as  follows.  Suppose 
copies  of  each  component  type  i are  available  for  testing. 
Place  a copy  of  the  ith  component  on  test,  and  replace  it 
when  it  fails.  Continue  testing  with  replacement  until  all 
available  copies  of  one  component  are  exhausted  (this  proce- 
dure need  not  be  conducted  simultaneously  for  all  component 
types).  For  the  ith  component,  denote  the  time  to  the  first 
failure  as  T^,  between  the  first  and  second  failure  as  T^* 
and  so  forth.  In  general,  the  time  between  the  jth  and 
(j-l)th  failure  on  the  ith  component  is  T.  .,  i = l,....,K 


where  the  T.  . are  in  mission  units.  Reference  4,  p.  84o, 
also  describes  the  LR  procedure  for  Type  II  censoring  at 
the  rth  failure  of  R items  on  simultaneous  test.  Reference 
3.  p.  C-32,  illustrates  the  procedure  using  component  times 
between  successive  failures  and  the  observed  success  time 
of  the  last  copy  of  each  type  tested. 

The  LR  LCL  is  computed  as  follows.  Define 


0 


(2.32) 


Let  I^  be  the  greatest  index  such  that 
Ii 

L T,  , < U i = l ,K 


Also  define 


K 


i 


(2.33) 

(2.34) 
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The  variable  I is  the  total  number  of  failures  in  all  com- 
ponents up  to  and  including  U (see  Figure  1).  Then  the  LR 


100(l-ct)?5  LCL  for  system  reliability  R is  given  by 


S,L(cl) 


72 

= Exp(~  ) 


(2.35) 


Figure  1 

Depiction  of  Lieberman-Ross  Parameters 
U=35  and  1=6,  when  K=2,  Nt=Ut  and  N2=3 


COMPONENT 

i=2,N2=3 


To  implement  the  LR  procedure,  the  component  data 
order  must  be  specified.  If  only  a set  of  component  data 
were  available,  then  a different  procedure  would  have  to  be 
used.  Note  that  the  opposite  chi  square  tail  is  used  from 
that  of  the  LG  and  CLG  methods. 

2.  The  Modified  Lieberman-Ross  Method 

The  original  procedure  utilizes  accumulated  compo- 
nent times  between  failures.  The  Modified  Lieberman-Ross 
procedure  (MLR),  uses  instead  component  times  to  one  mission 
unit  or  failure,  whichever  occurs  first.  The  MLR  method  is 
thereby  more  readily  applied  than  the  LR  method  to  actual 


19 


system  test  data,  especially  when  testing  is  destructive 
(for  example,  a missile  firing).  The  MLR  method  also  can 
be  used  when  no  failures  occur,  whereas  the  LR  method  could 
not  (see  Appendix  D), 

The  MLR  procedure  is 

a.  Suppose  copies  of  the  ith  component  are  avail- 
able for  testing.  Define  Tjj  as  for  the  LR  procedure,  ex- 
cept all  times  past  one  mission  unit  are  truncated  to  one. 


Next,  define 


0 


il 

Vu 


where  ij  is  the  index  of 
the  first  component  time 
less  than  one  mission 
unit  for  the  ith  component 


where  i2  is  the  index  of 
the  second  component  time 
less  than  one  mission  unit 
for  the  ith  component 


where  iF^  is  the  index  of 
ip.  the  last  component  time 

L1  T.  . less  than  one  mission  unit 
. . for  the  ith  component 

^(F^l)*1 


Then  obtain 


(2.37) 


(2.38) 


• ^i  * 

T.  = £ T.  . i = 1 K (2.39) 

1 j=l  iJ 

b.  Compute  the  minimum  accumulated  times  between 


successive  failures  in  any  component  type. 


U = 


f min  m* 
l<i<K  A 


i min  »» 
ll<i<KNi 


K 

if  L F,  > 0 
i=l  1 

K 

if  I F*  = 0 
i=l 


(2.40) 


(see  Appendix  D) 
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The  variable  I ^ is  now  defined  in  terms  of  the  T*. 


Ji  = 


the  greatest  index  such  that 


Ji  * 

2 T.  . < U 
j=l  1J  " 


if  Pi>0 


if  Pi  * 0 


Then 


I = max  < 1 , Z I , 

i=l  1 


c.  Now  the  MLR  lOO(l-a)#  LCL  for  R can  be 

s 


computed 


lS,L(a)  ' Expi  2U 


-la. 21 


Like  the  LR  method,  the  component  data  order  must  be 


specified. 


III.  THE  SIMULATION 


A.  GENERAL  METHODOLOGY 

Any  lower  confidence  limit  (LCL)  procedure  can  be  evalu- 
ated by  computer  simulation  of  its  distribution  as  follows » 
1.  Suppose  it  is  desired  to  evaluate  a proposed 
100(l-a)?S  I£L  procedure,  denoted  RgfL(a)»  for  system  relia- 


bility R . Then  the  assertion  is 
2 


Pl?S.L(a)-Rs]  ^ 1 - a 


(3.1) 


Rs = f (R1#R2, . . . , ,Rk) , where  R^  is  the  true  reliabil- 


Equality  should  hold  if  R<,  is  a continuous  random 

variable. 

2. 

ity  of  the  ith  component.  For  an  independent  series  system, 
K 

R = TT  If  exponentiality  is  assumed,  an  equivalent 

3 i=l  1 

statement  is  Rg  = f (X1#X2, . , . . ,A.) . 

3.  Assign  values  to  the  parameters  a,  K,  and  R^  (or 

i = 1 ,2, . , , . ,K.  Simulate  life  testing  by  generating  random 
component  times-to-failure,  and  compute  the  resultant 

A 

RS,L(a)  * 

i A 

4.  Generate  the  approximate  distribution  of  Rg 
by  repeating  step  3 five  hundred  times. 

A A 

5.  Order  the  R„  T#  % realizations  to  get  Rc  T , n ,... 


A 

. . . , R 


S,L(a) 


(500) 
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and 


6.  Find  the  (l-a)500th  order  statistic  of  Rg  ^ ^ 
denote  it  A1-a.  Thus  A1-a  is  the  (l-a)th  percentile  of 

A 

the  distribution  of  the  LCL  random  variable  Rg  L(a)»  If 

in  fact,  Rg  is  an  exact  100(1- a)#  LCL  procedure  for 

R_,  then  A,  should  be  approximately  equal  to  R_. 
s i-a  s 

7.  By  repeating  steps  3 through  6 for  various  sets  of 
K,N1,N2,,,,,,Nk,  Rj^  ,R2, , . . . ,Rk  and  a,  and  comparing  the 
resultant  A,  to  R.  the  overall  performance  of  the  LCL 

X “ft  S 

procedure  can  be  evaluated. 

A 

The  actual  confidence  level  given  by  Rg  ^(a)  can  te  ot)_ 
tained  by  finding  the  order  statistic  of  the  generated 
distribution  which  matches  (or  closest  matches)  R . If 

w 

# 

the  index  of  this  order  statistic  is  denoted  i , then 

i*  a 

(lOO^)j^  = Actual  Level  of  Confidence  of  Rg  ^ ^ (3.2) 

Equivalently,  if  A.  <R_,  the  procedure  is  a conservative 

“CC  a 

one,  and  vice-versa. 

Figure  2 depicts  a conservative  outcome  with  A^  <RS* 

The  degree  to  which  A-  equals  R reflects  the  validity 

x —a  s 

A 

of  equation  (3.1)  and  therefore  the  accuracy  of  Rg 

Figure  2 

"s,L(a) 


L.  . 


Not  only  should  an  LCL  procedure  be  accurate,  but  also 

A 

should  have  small  standard  deviation.  Even  though  Rs 
may  be  an  exact  LCL  procedure,  its  practical  value  is 


diminished  if  it  produces  widely  dispersed  LCL's.  This 
study  used  both  criteria  for  comparison  of  the  three  methods. 


B.  GENERATION  OF  SAMPLE  SIZES 


The  component  test  data  are  generated  in  a manner  some- 
what representative  of  data  accumulated  in  missile  flight 
tests.  Suppose  some  number  of  series  systems  are  to  be 
used  for  testing.  Failure  of  a component  may  fail  the  sys- 
tem, but  still  allow  testing  on  components  upstream  of  the 
failed  one.  For  example,  if  the  system  is  a five-stage 
missile,  failure  of  the  third  stage  may  or  may  not  allow 
testing  on  stages  four  and  five. 

Input  parameter  N^,  the  number  of  mission  tests  on  the 
first  component,  is  the  number  of  systems  to  be  tested.  A 
component  failure  is  assumed  to  preclude  testing  on  upstream 
components  one-half  the  time.  The  simulation  computes  the 
number  of  tests  on  the  ith  component  as 

i-1 

N.  = N.  - | I F . (3.3) 

1 1 L 3*1 

where  "[  ]"  denotes  "the  smallest  integer  greater  than  or 
equal  to".  To  illustrate,  let  Nj=20  and  assume  the  first 
component  had  three  failures.  Then  the  component  two 
sample  size  becomes 

N2  = 20  = 18  mission  trials 
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It  should  be  understood,  however,  that  the  three  procedures 
themselves  do  not  require  this  scheme,  but  are  valid  for 
varying  sample  sizes. 

C.  THE  SIMULATION  ALGORITHM 

Step  one i Initilize  the  number  of  series  components  K, 
the  number  of  systems  to  be  tested  N^,  , the  true  reliability 
of  the  ith  component  R^,  i=l,2,,..,K,  and  the  number  of 
replications  desired  ("Do  Loop"  index). 

Step  twot  Using  the  probability  integral  transform 
(PIT)  method  [Ref,  5»  p.  168] , generate  exponential  failure 
times  for  the  N,  copies  of  the  first  component  as  shown 
below.  Exponential  failure  data  is  a requirement  for  the 
CLG  and  LR  methods.  The  LG  method,  being  non-parametric , 
can  use  the  same  data, 

a.  Generate  N^  uniform  (0,1)  random  numbers  for 
component  one.  Denote  these 


,U 


IN, 


b.  Let  = 


0 if  a success  occurred  for  compo- 
nent one  on  trial  j 

1 if  component  one  failed  on  trial 

1 


(3.4) 


Appendix  E shows 

i 

j » j=l *2,,,.,, 

o 

n 

rl 

if 

0 < Ux  j <Exp(-Ai) 

u 

if 

Exp(-Xi)  <UXj  <1 

and  Tj.  = f 1 

if 

P13  = o 

Ln<V 

X1 

r 

if  br1 

(3.5) 


j=l * 2, . . • , N^ 
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c.  For  the  LG  method,  compute 


A1  = 


(2Nt  - 3) 
(2N~  - 2) 


B1  = ^TT 


Nl 


(3.6) 


(3.7) 


(3.8) 


d.  For  the  CLG  method,  compute  the  test  time  for 


component  one, 

Ni 

Tsura.  = £ T1  • 

1 j=l  1J 

Step  three i Compute 

a F-  B.  F1  2 

T1  = A1^N^  + 


(3.9) 


(3.10) 


for  the  LG  method,  and 


Z - 1 

L1  ~ Tsum. 


(3.1D 


for  the  CLG  method. 


Step  fouri  The  component  test  times  for  the  MLR  method 
are  defined  differently  from  that  of  the  CLG  method.  The 
MLR  method  uses  only  accumulated  time  to  the  last  failure 
for  each  component!  if  no  failures  occur  this  is  zero. 


Thus,  compute  for  component  one 

* ?1  * 

‘ Tl  = L Tii 
1 j=l  ^ 


if  Fj_  > 0 


(3.12) 


where  T,  . is  as  defined  on  page  20. 
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Step  five i Compute  the  number  of  trials  on  component 


two, 


Repeat  steps  two,  three,  and  four  for  component  two.  Then 
compute  N-j  = ^ - [j(P1  ♦ F2)]  . In  general,  the  sample  size 
for  the  ith  component  is 


i-1 
I F 
3=1 


3 


(3.13) 


Step  sixi  Continue  alternating  through  steps  two 
through  five  for  the  remainder  of  the  components. 

Step  Severn  Obtain 


S 


K 

I 

i=l 


A 

T. 


(3.1*0 


- K - , 

Z = Z Z.  (3.15) 

i=l  1 
K 

Var(S)  = Z (T./N. ) (3.16) 

i=l  1 1 

Var(Z)  = Z (Z./N.)  (3.17) 

i=l  1 X 

r = S2/v2r(S)  (3.18) 

L = Z2/Var(Z)  (3.19) 

and  the  total  number  of  replica  failures 
K 

FT  = I F.  (3.20) 

i=l  1 


27 


'I 


Step  eight i To  preclude  non-integer  degrees  of  freedom, 
denote 

[2r]  = max|2,  smallest  integer >2r| 

[*£]  = max^2,  smallest  integer  >2L^ 

Step  nine i For  the  MLR  procedure,  compute 


(3.21) 

(3.22) 


U = I min 
min  T* 


if  FT  = 0 

otherwise,  i=l,2,...,K 


(3.23) 


and 


1^  = r greatest  index  such  that 


L1 T*. < U 
j=l  1J 


K 


if  Fi>  0 


if  Fi  = 0 


(3.24) 


then  obtain  I = max  ^ 1 , L 1 1 

i=l  1 


(3.25) 


The  zero  failure  portion  of  the  U computation  sets  U to 
the  observed  number  of  "system"  successes  (see  Appendix  D), 
Step  ten*  Compute  the  replica  one  LCL's  for  the  three 
procedures.  Define  RD,  RT,  and  RL  for  discrimination  as 
below 


a.  LG  method 


*S.L(<j)  * m ’ E*P 


[Xl-a,[2r] 


b.  CLG  method 


*S,L(a)  5 RT  = Exp  ^72 


c,  MLR  method 


RS,L(a)  = RL  = Exp 


(3.26) 


(3.27) 


(3.28) 
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Step  elevent  Replicate  steps  two  through  ten  5 00  times 


to  obtain 


RD.  , 

RD„ 

1* 

2* 

500 

RT. , 

RT„, 

2* 

RL. , 

RL. 

FT. , 

FT., 

X* 

Step  twelve*  Order  the  LCL’s  in  step  eleven. 


RD(i),  RD(2), ,RD(500) 

RT(1)»  RT(2) RT(500) 

RL(1)»  RL(2)... RL(500) 


Step  thirteen*  Next,  compute  A^_a  for  the  three  proce- 
dures. 

^(500(1-00) 

RT(500(l-a)) 

RL(500(l-a)) 

and  the  average  number  of  failures  per  replica 


^ i 500 

” " 3TO  £ "j  (3*29) 


Each  procedure's  sample  variance  is  computed  by 


s = 


1 5°° 
**  ih  l 


(RS,Ii(a)^3  “ (RS,L(a)} 


1 2 


(3.30) 


where  &s  denotes  the  average  LCL  over  the  500  replicas. 

Now  each  procedure's  accuracy  can  be  determined  by  comparing 
to  true  system  reliability  Rg,  and  relative  dispersion 
by  comparing  s. 
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Reference  1,  the  original  LG  method  paper,  used  the 


quantity 

K 

TT  = £ N.Q.  (3.31) 

i=l  1 1 


as  a measure  of  accuracy  and  the  amount  of  testing  necessary 
to  assure  sufficient  accuracy  of  the  LG  procedure.  As  long 
as  no  component  sample  size  is  below  ten,  Table  I shows 


IV.  THE  INITIAL  SIMULATION 


A.  CASE  DESCRIPTION 

The  initial  cases  analyzed  had  true  system  reliabilities 
ranging  from  near  .70  upwards  and  were  composed  of  fifteen 
or  forty  components.  The  average  number  of  failures  per 

A 

replica,  TT,  ranged  up  to  near  15.  The  first  simulation 

A 

used  the  formulas  for  Rg  L(a)  on  page  28.  The  results  are 
listed  in  Table  III.  Two  cases  were  also  ran  with  a Weibull 
failure  distribution,  vice  exponential,  to  test  the  CLG  and 
MLR  procedures  sensitivity  to  the  exponential  assumption. 
Appendix  E develops  the  PIT  method  for  generating  exponential 
and  Weibull  failure  data.  Table  IV  lists  Weibull  results. 

B.  RESULTS  AND  ANALYSIS 

The  LG  method  conformed  to  Reference  1 assertions  in 

A 

that  performance  improved  with  increasing  TT,  although 
Ref.  1 did  not  generate  component  sample  sizes  in  the  same 
manner  as  this  study.  This  should,  however,  have  no  effect 

on  the  results, 

/>> 

Small  TT,  such  as  in  cases  one  and  three,  resulted  in 
conservative  LG  and  CLG  LCL's  (ie..  A,  <R_). 

X •(!  S 
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TABLE  II 


min 

max 

/s 

TT 


Al-a 

LG 

CLG 

MLR 

RLG 


NOMENCLATURE  FOR  SIMULATION  RESULTS  TABLES 

i Sample  size  of  1st  component;  analogous  to  the 
number  of  systems  tested 

i Number  of  series  connected  components 

i True  reliability  of  the  ith  component 

i True  independent  series  system  reliability 
K 


i Minimum  number  of  failures  in  one  replica 

« Maximum  number  of  failures  in  one  replica 

i Average  number  of  failures  per  replica;  approx- 
imation for  K 

TT  - L N.Q. 
i=l  1 1 

A 

i Sample  standard  deviation  of  Rg 

i The  500(l-a)th  order  statistic  of  jL  ,/  % for 
each  of  the  three  methods  o.Ma/ 

i The  Log-Gamma  method 

i The  Continuous  Log-Gamma  method 

i The  Modified  Lieberman-Ross  method 

i The  Randomized  Log-Gamma  method  (modification 

three  only) 


For  example,  the  case  one  sample  size  for  the  first 
component  was  N^  = 20,  and  the  series  system  modeled  had 
K = 15  components  each  with  true  reliability  Ri = .99.  True 
system  reliability  Rg  = .860,  There  were  as  few  as  zero 
(min=0)  and  as  many  as  eight  (max  = 8)  component  failures 
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TABLE  III 


. 059  . 794/. 225  . 775/.  058  . 773/. 059  . 79 6/.  235 


over  the  5 00  replicas  of  case  one,  with  the  average  number 

A 

of  failures  per  replica  being  2.9  (TT=2.9).  Comparing 

A1  to  R_  for  accuracy,  the  LG  80#  procedure  had  A * =.799 

and  ss.O?^,  whereas  the  MLR  had  A1_a=.851  and  s=.255. 

Thus,  in  case  one  both  procedures  were  conservative,  but 

the  MLR  was  more  accurate.  However,  the  LG  procedure  had 

-less  than  one-third  the  dispersion  of  the  MLR  procedure. 

Increased  testing,  as  in  cases  two  and  four,  not  only 

improved  their  accuracy  but  showed  smaller  sample  standard 

deviation.  The  same  comparison  holds  for  case  five  with 

case  six,  and  case  seven  with  case  eight.  Also  note  the 

closeness  of  both  A1  and  s for  the  LG  and  CLG  methods, 

i -a 

This  basically  says  that  even  though  more  assumptions  are 
required  and  information  is  needed  for  the  CLG  method  than 
the  LG  method,  it  yields  no  better  results. 

Case  three  of  Ref.  1 is  essentially  case  five  of  Table 
IIIl  case  five  is  essentially  case  six,  and  case  eleven  is 
essentially  case  two  (note  that  Ref.  1 miscomputed  TT  in 
cases  three  and  five).  The  accuracy  achieved  by  case  five 
was  not  as  high  as  that  of  case  three,  but  the  sample 
standard  deviation  was  comparable.  In  the  other  two  compar- 
able cases,  both  the  accuracy  and  dispersion  match  closely. 
The  MLR  procedure  is  the  most  accurate  of  the  three, 

/N 

both  in  low  and  high  TT  cases.  The  sample  standard  devia- 
tion, however,  is  three  to  five  times  that  of  the  LG  method. 
The  most  disturbing  thing  about  the  MLR  method  is  that  even 
with  increased  testing  (TT),  s is  still  high. 
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Reference  6 shows  that  the  LR  method  is  expected  to 
have  high  dispersion  above  about  ten  observed  failures 
(Figure  1,  p.  22).  The  MLR  method,  even  in  the  cases  with 
ten  or  more  failures,  still  has  much  higher  dispersion 
than  the  LG  and  CLG  procedures.  Reference  6 attempted  to 
improve  the  LR  method  by  reduction  of  data  loss.  By 
ordering  the  failure  times  in  increasing  order,  maximum  data 
usage  and  chi  square  degrees  of  freedom  were  attained.  The 
resultant  LCL's  were  found  to  be  biased  in  an  unpredictable 
direction  (based  on  a single  parameter)  and  were  even  more 
widely  dispersed.  It  was  therefore  proposed  that  all  possi- 
ble orderings  of  the  data  be  considered,  and  research  is 
currently  being  conducted  in  that  area.  Thus  this  study 
pursued  it  no  further. 

The  two  Weibull  cases  showed  that  the  CLG  and  MLR  methods 
were  slightly  sensitive  to  the  exponential  assumption. 

Since  T^  exponential  (X)  implies  T1^  ^ Weibull  (0,X)  (see 
Appendix  E),  then  for  0=,5  and  T<1  mission  unit,  the  gen- 
erated Weibull  failure  time  is  sooner  than  its  exponential 
counterpart.  Likewise,  for  0=3.0,  the  Weibyll  time  is 
later.  In  fact,  case  one  with  0=.5  gave  slightly  lower 
A^_a  for  both  methods  (excepting  the  80^  MLR  LCL) . With 
0=3.0,  both  cases  gave  slightly  higher  A1-a  (again,  with 
the  same  exception  as  above). 


37 


V.  MODIFICATIONS  OF  THE  METHODS 


A.  MODIFICATION  ONEi  EXACT  DEGREES  OF  FREEDOM  AND  ADJUST- 
MENT FOR  ZERO  FAILURES 

1.  Description 

The  original  LG  method  employed  only  integer  de- 
grees of  freedom?  the  initial  results  of  Chapter  IV  adhered 
to  this  convention  for  all  three  methods.  The  accessibility 
of  computers  today  makes  chi  square  values  with  non-integer 
degrees  of  freedom  readily  available.  Rounding  up  degrees 
of  freedom  by  usage  of  the  "smallest  integer  greater  than 
or  equal  to"  function  can  also  cause  nonotonicity  problems 

A 

in  Rs  L(a)*  Consider  LG  80>  LCL's  in  the  case  where  N1=20, 
and  only  one  failure  occurs.  Then 


A 

S 


Kr15A 

i=l 


A 

r 


= .05 

32 


15  *7 

ill  Ni 


_Ll052L_ 

(.  05/20) 


= 1 


(5.D 


(5.2) 


then 


thus. 


RS,L(a)  = ExP 


(5.3) 
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*S,L(.2)  -S*pj  - -799 

L /L.8,2  J 

Now,  take  the  exact  same  case  and  outcome,  except  that  in- 
stead of  one  failure  in  one  component,  two  failures  occur 
in  the  same  component.  Then, 

S = .103 


A 

r 


-iiisar..- 

(.103/20) 


2r  = 4.105 

[2 t]  = 5 


2.053 


It  follows  that, 


RS,L(.2) 


2xp 


i_-5(.103) 
^ 72 

A/. 8, 5 


.803 


The  above  LCL  is  higher  even  though  one  more  failure  oc- 
curred, due  to  rounding  up  degrees  of  freedom  2r. 

Another  improvement  felt  necessary  was  an  adjustment 
for  the  event  of  no  failures  for  the  LG  method.  The  initial 
procedure  here  gives 

A 

s = 0 

A 

and  Rc  T t \ =1.00 

Therefore,  the  following  was  incorporated!  Suppose 
there  are  no  failures  in  one  replica  with  N1  initial  compo- 
nent trials.  Then  set  the  number  of  failures  on  the  first 
component  as  i and  compute  2r  as  if  one  failure  had  oc- 

A 

curred  (this  effectively  constrains  2r>  2).  This  ad  hoc  and 
simplistic  adjustment  will  produce  zero-failure  LCL's  as  a 
function  of  N^,  and  satisfies  monotonicity  requirements. 


39 


The  simulation  was  again  run  with  the  adjustments 
above  for  certain  test  cases.  The  results  are  listed  in 
Table  VI. 

2.  Observations  and  Analysis 

Due  to  the  fact  that  the  MLR  method  never  assumes 
non-integer  degrees  of  freedom,  it  was  unaffected  by  this 
modification.  Both  cases  tested  had  slightly  lower 
and  sample  standard  deviation,  s for  the  LG  and  CLG  methods. 
The  smaller  s can  be  attributed  to  less  discreteness  in 

Rs  L(a)*  ^ower  ^1-a  caused  "*:^e  ^ac-t  that  2i_a  2n 

increases  faster  than  2n.  By  rounding  up  the  degrees  of 

freedom  2n  to  [2n],  the  initial  simulation  produced  slightly 
higher  LCL's  than  did  modification  one. 


TABLE  V 

Behavior  of  — ^ for  a=  .2 

'X  l-a,2n 


2n 

T?8,2  n 

2n 

2 

.446 

4.48 

3 

1.01 

2.97 

5 

2.34 

2.14 

10 

6.18 

1.62 

30 

23.4 

1.28 
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While  this  modification  slightly  decreased  disper- 
sion, it  did  not  improve  the  accuracy  of  the  LG  and  CLG 
methods  (and  had  no  effect  on  the  MLR  method).  The  only 
real  gain  was  to  solve  an  infrequent  monotonicity  problem. 

If  only  integer  degrees  of  freedom  are  available,  it  is 
recommended  that  a more  refined  scheme  of  rounding  non- 
integer outcomes  be  devised.  For  instance,  in  the  earlier 
example,  2r  = 4,105  should  be  rounded  down  to  4 vice  up  to 
5.  The  LG  LCL  becomes  ,779»  which  is  lower  than  the  one- 
failure  .799  outcome,  but  still  higher  than  the  .738  three 
failure  outcome  (see  Table  VII). 

Being  that  the  CLG  method  performs  no  better  than 
the  LG  method,  but  requires  more  assumptions  and  informa- 
tion, no  further  effort  was  expended  on  it.  All  subsequent 
modifications  are  directed  towards  improving  the  accuracy 
of  the  LG  method  while  maintaining  small  dispersion. 

B.  MODIFICATION  TWO 

1.  An  Accuracy  Improvement,  and  an  Adjustment  for  the 
Degrees  of  Freedom  in  the  90^  Lower  Confidence 
Limit  Procedure 

The  primary  weakness  of  the  LG  method  is  its  poor 
performance  when  few  failures  occur.  More  testing,  and 
thereby  more  failures,  results  in  a more  accurate  Aj^  • 
Table  VII  lists  and  plots  possible  LG  LCL’s  for  zero  through 
ten  failures  when  = 20.  Note  the  gaps  caused  by  discrete- 
ness up  to  one  failure.  Also  note  that  the  LCL  for  two 
and  three  failures  is  higher  than  that  for  one  failure. 
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This  non-mo not onicity  is  caused  by  the  sharp  drop-off  in 
ll-a=/(29  ^ow  degrees  of  freedom.  As  an  adjustment, 

2r  for  90#  LG  LCL's  was  constrained  to  be  at  least  2 . 5 1 
the  minimum  2r  for  80#  LCL's  remains  2.0.  The  results  can 
be  seen  in  Table  VIII, 

Consider  the  classical  binomial  component  LCL  pro- 
cedure on  the  probability  of  mission  success  p.  If  p is 
estimated  by  p = X/N  where  X is  the  observed  number  of 
successes  in  N trials,  then  a 100(1 -a)#  LCL  on  p,  denoted 


^L(a)'  solution  for  p in  the  equation 

I (^)  pj(l  - p)N*j  = a 

j=X  J 


(5.*) 


Under  the  simulation  of  Chapter  III,  if  Nj.  is  the  component 
one  sample  size  and  no  failures  occur  in  a replica,  it  can 
be  equivalently  stated  that  "systems”  were  tested  with- 
out failure.  Likewise,  one  component  failure  implies  ex- 
actly one  system  failure.  However,  when  two  or  more 
different  types  of  components  fail,  it  cannot  be  ascertained 
how  many  system  failures  occurred.  Figure  3 illustrates 
this  for  the  two-failure  case. 


Figure  3 

Component  Failures  Versus  System  Failures 


Component 


1 2 


N.  systems  x x 
tested  with 


- or 


N.  systems 
tested  with 
two  system 
failures  ? 


1 2 
x - 
- X 
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Treating  a "system"  as  a component,  equation  (5.4) 

A 

can  be  used  to  calculate  R<,  when  zero  or  one  failures 

occur. 

a.  Zero  failures! 

For  X=N  successes,  = a1//Nl , Modifica- 

tion two  revised  this  upwards  to 

*S,L(a)*  + . 2<1  - Hly^)  (5.5) 

b.  One  failure* 

Equation  (5.4)  was  applied  directly  for  X=Ni-l, 

_ A 

That  is,  Rg  is  the  solution  for  p in  the  equation 

(5.6) 


N« 


21  pJ(i-p)Ni-^  a 
or  N1pN^“1(l-p)  ■¥  pNl  = a 


(5.7) 


c.  Two  through  eight  failures! 

The  LG  method  was  adjusted  upwards  as  follows! 

(5.8) 


RS,L(a) 


where  Rg  x,(a)^Nl,RT^  denotes  the  LG  LCL  computed  with  the 
observed  total  replica  failures  FT  when  the  original  sample 
size  is  N^. 

d.  More  than  eight  failures! 

The  original  LG  procedure  is  used  with  exact 
degrees  of  freedom.  The  results  are  in  Table  IX. 
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2.  Observations  and  Analysis 

Modification  two  did  improve  the  accuracy  of  the 
LG  method,  while  slightly  increasing  dispersion.  The  90ft 
procedure  was  noticeably  improved  by  the  degrees  of  free- 
dom constraint,  although  still  conservative.  There  is, 

A 

however,  still  too  much  discreteness  in  values  of  Rg  L(a) 
when  few  failures  occur.  Table  X generated  at  NPS  by  APL 
subroutine  "Histlist"  (see  documentation) , illustrates  this 
for  case  five.  This  discreteness  usually  causes  the  proce- 
dure to  yield  more  than  the  target  1-a  confidence,  and  is 
a problem  with  nearly  any  method  using  only  attributes  data. 

This  being  the  case,  the  next  logical  step  was  to 
fit  a continuous  curve  to  the  procedure  by  randomization, 

C.  MODIFICATION  THREE i RANDOMIZATION 

1 , Randomization  of  the  Log-Gamma  Method 

Many  LCL  procedures  which  use  only  attributes  data 
are  degraded  in  that  they  yield  conservative  bounds.  Be- 
cause only  a finite  set  of  outcomes  can  be  observed  for  any 
test  plan,  then  only  a finite  set  of  LCL’s  can  be  realized. 

A 

Thus,  Rg  is  a discrete  random  variable  which  ideally 

gives  the  LCL  closest  to  but  not  greater  than  the  "exact" 

LCL. 

The  1975  article  of  Barr  and  Jayachandran  [*Ref.  7» 
p.  67-68]  developed  an  exact,  randomized  binomial  component 
LCL  procedure.  The  same  rationale  used  before  (see  Figure  3) 
allows  the  randomized  binomial  procedure  to  be  used  for 
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TABLE  X 

Case  5 Log-Gamma  80  Percent  LCL's  with  Modification  Two 


SERIAL  NUMBER 

ORDERED  DATA 

OCCURENCES 

PERCENT 

1 

.407610 

1 

.002 

2 

.444490 

1 

.002 

3 

.444960 

1 

.002 

4 

.471830 

1 

.002 

5 

.475840 

2 

.004 

7 

.477390 

3 

.006 

10 

.482700 

2 

.004 

12 

.484660 

1 

.002 

13 

.487430 

1 

.002 

14 

.527610 

1 

.002 

15 

.534450 

3 

.006 

18 

.538120 

10  * 

.020 

28 

.538550 

1 

.002 

29 

.540650 

1 

.002 

30 

.541090 

1 

.002 

31 

.542420 

2 

.004 

33 

.542860 

1 

.002 

34 

.571020 

11  * 

.022 

45 

.576210 

1 

.002 

46 

.577770 

7 * 

.014 

53 

.578300 

2 

.004 

55 

.580530 

10  * 

.020 

65 

.581070 

1 

.002 

66 

.583950 

1 

.002 

67 

.584260 

2 

.004 

69 

.584910 

2 

.004 

71 

.616160 

13  ** 

.026 

84 

.620600 

5 * 

.010 

89 

.622570 

14  ** 

.028 

103 

.623270 

1 

.002 

104 

.624390 

24  **•» 

.048 

128 

.625090 

2 

.004 

130 

.627950 

1 

.002 

131 

.628010 

1 

.002 

132 

.628080 

1 

.002 

133 

.662770 

23  *#* 

.045 

156 

.666380 

1 

.002 

157 

.6664-90 

14  ** 

.028 

171 

.667840 

1 

.002 

172 

.668570 

16  ** 

.032 
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TABLE  X 
(continued) 


SERIAL  NUMBER 

ORDERED  DATA 

OCCURENCES 

PERCENT 

188 

.669380 

21  *** 

.042 

209 

.669530 

1 

.002 

210 

.670340 

6 * 

.012 

216 

.671090 

2 

.004 

218 

.672070 

1 

.002 

219 

.673220 

1 

.002 

220 

.710230 

-57  **** 

.074 

257 

.713320 

22  *** 

.044 

279 

.714870 

25  *** 

.050 

304 

.715380 

6 * 

.012 

310 

.716280 

2 

.004 

312 

.756600 

47  ******  # 094 

359 

.758850 

21  *** 

.042 

380 

.759200 

2i  *** 

.042 

401 

.761320 

2 

.004 

403 

.789380 

2$  ***** 

.078 

442 

.791840 

27  *** 

.054 

469 

.890140 

21  *** 

.042 

490 

.938140 

11  * 

.022 
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"system"  LCL's  when  zero  or  one  failure  occurs.  Equations 
for  the  Randomized  Log-Gamma  method  (RLG)  are  derived  in 
Appendix  F,  An  example  is  given  in  Appendix  G, 
a.  Randomized  Log-Gamma  Procedure 

(1)  If  zero  failures  occur,  generate  a uniform 
(0,1)  random  number  Y.  Then 


r 


S,L(a) 


(■ 


■) 


1/Nl 


if  Y <1  - a 


(5.9) 


1 - Y 

1,0  if  Y > 1 - a 

(2)  When  one  failure  is  observed,  generate  a 
uniform  (0,1)  random  number  Y,  Then  Rg  L(a)  is  "the  solu- 
tion for  p in  the  equation 

(1  - Y)N1pNl"1(l  - p)  + pNl  = a if  Y < 1 - a (5.10) 

This  solution  can  be  approximated  by 

SS,L(a)=  “1/Nl  <5-ll) 

for  Y>  1-a  (see  Appendix  F). 

(3)  Two  through  four  failures  inclusive i 

Generate  a uniform  (0,1)  random  number  Y^ 

for  each  component  that  had  at  least  one  failure,  i=l,2,... 

* 

, ,,,K,  Then  use  the  LG  method  with  F^  = F^  - Y^  instead  of 
Fj.  Thus,  the  RLG  formulas  become 


Ai  = 


2Ni-3 
21^  - 2 

Ni 

Bi  --TT ^r- 


(5.12) 

(5.13) 
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k.  . 


r 


A 

Ti 


F.  - Y. 
A- ( — k i 


N. 


B.  F.  -Y.  2 

> + -^-V^ 


/>  K . 

S = Z T. 
i=l  1 


and 


$2 

£ = — ^ 


K T, 

V i_ 

i=lNi 


S - ~xpF  -2rs 

RS,L(a)  ' ~xp1  72 

l /U-a,2r 


(5.14) 

(5.15) 

(5.16) 

(5.17) 


The  only  differences  between  the  original  LG  formulas  and 
those  above  is  the  computation  of  T^  in  equation  (5.1*0, 
and  usage  of  exact  degrees  of  freedom. 

(4)  Five  or  more  failures  1 

Use  the  non-randomized  LG  method  with  ex- 
act degrees  of  freedom.  That  is,  use  the  formulas  in  (3) 

A 

above  except  use  F^  vice  - Y^  in  the  computation  of  T^. 

2.  Modification  Three  Cases 

The  number  of  cases  simulated  under  modification 

three  was  expanded  greatly.  Cases  one  through  twelve  have 

an  of  either  20  or  50,  and  cover  the  range  of  pertinent 

system  reliability  R_,  All  twelve  cases  were  first  ran 

s 

with  the  number  of  components  K=15»  and  then  reran  with 
K=40.  Cases  with  equal  component  reliabilities  were  also 
ran  with  K=4.  The  system  sample  size  was  reduced  to  ten, 
and  the  applicable  twelve  cases  ran  again,  with  K = 15»  40, 
and  4.  Modification  three  results  are  listed  in  Table  XI 
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for  K = 15»  Table  XII  for  K = 40,  and  Table  XIII  for  K = 4. 

Table  XIV  lists  results  of  cases  from  Ref.  1,  which  had 
highly-varied  component  sample  sizes. 

3.  Results.  Analysis,  and  Conclusions 

All  three  method  results  were  tabled  for  comparison 
under  modification  three,  although  randomization  of  the  LG 
method  was  the  only  change. 

The  accuracy  of  the  RLG  was  comparable  to  that  of 
the  MLR,  while  having  much  lower  sample  standard  deviations. 
Both  the  RLG  and  CLG  methods  had  dispersion  inversely  pro- 
portional to  sample  size,  while  the  MLR  continued  to  con- 
sistantly  have  high  dispersion  regardless  of  the  circumstances. 

The  most  significant  improvement  in  the  RLG  was  its 
performance  with  few  failures  and  less  testing.  Especially 
in  the  K = ^ and  K=15  cases  with  small  TT,  the  RLG  was  near 
exact  while  the  CLG  sometimes  gave  A1_a  of  1.00  (meaning 
at  least  the  upper  (100) a#  of  the  simulated  distribution 
was  LCL's  of  1.00).  The  MLR  procedure  was  inaccurate  for 
very  high  reliability  systems,  such  as  case  11  with  K = 15» 
due  to  the  upper  limit  of  its  possible  LCL  values.  In 
case  11,  with  = 20,  the  maximum  MLR  LCL  is  .923  with  zero 
failures  (see  Appendix  D),  whereas  true  system  reliability 
is  .956.  As  in  the  earlier  LG  results,  the  90#  RLG  procedure 
was  usually  less  accurate,  less  stable  and  slightly  more 
dispersed.  The  presence  of  one  component  with  dissimilar 
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reliability,  like  case  seven  with  K = 15  seemed  to  degrade 
accuracy  somewhat.  Additional  testing,  however,  as  in  case 
eight,  dampens  this  out. 

Cases  one  and  two  of  the  original  LG  paper  [Ref.  lj 
v:ere  also  simulated  with  modification  three  to  check  sensi- 
tivity to  mixed  sample  sizes  (see  Table  XIV).  Note  that 
randomization  was  rarely  necessary  in  case  two  (min  =2), 
and  never  in  case  one  (min  = 5).  The  accuracy  of  all  three 
methods  was  high  due  to  the  large  amount  of  testing.  Note 
the  small  sample  size  of  the  twelth  component  in  case  one. 
This  seemingly  had  little  effect  on  the  RLG  method's  accura- 
cy, although  s is  suspiciously  large  when  compared  to  case 
two.  When  R12  was  set  to  .85,  the  effect  on  the  RLG  became 
clearer.  When  a component  twelve  failure  occurred,  its 

^ A A 

contribution  to  S and  r so  dominates  that  Rg  is  nearly 

halved  from  what  it  would  have  been  otherwise. 

Figures  4 and  5 give  histograms  for  Rg  of  the 

RLG  procedure  generated  under  cases  one  and  two  respectively. 
Both  have  skewness  and  kurtosis  roughly  comparable  to  a nor- 
mal distribution,  and  both  have  medians  near-equal  to  their 
medians  (symmetric).  Figure  5 (case  two  with  Nj.  = 50)  has 

A 

a lower  maximum  Rg  L(a)  and  a higher  minimum  than  Figure  4 
(case  one  with  ^=20),  reflecting  the  decreased  dispersion 
of  the  RLG  procedure  with  increased  testing. 
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TABLE  XI 


. 864  . 864/. 122  1 . 00/. 1 69  . 851/. 280  . 856/. 1 76  1 . 00/.  238  . 794/.  2?9 


2 . 8 .738  . 747/. 143  . 639/. 132  . 71 6/. 250  . 749/. 155  .466/.  13I  . 723/.  241 


TABLE  XI 


956  . 952/. 096  1 . 00/. 177  . 851/. 196  . 964/.  132  1 . 00/ . 282  . 794/.  204 


TABLE  XII 


3.5  .672  .665/.I56  .592/.129  .660/.273  .683/.  147  .450/.115  .671/.250 


TABLE  XII 


TABLE  XII 
(continued) 
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Figure  5 
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APPENDIX  A 


APPROXIMATION  OF  S BY  A TAYLOR  SERIES 
The  Taylor  series  approximation  of  f(x)  about  x = a 


• t • ^ 


can  be  stated  as« 

f(x)  = f (a)  ♦ f '(a)(x-a)  ♦ f (a)jx-a) — + . . . ♦ 

. fi(a)(x  - a)1 

. . . + £{  + • • • 

Here,  f(x)  = -ln(x),  where  x=(l-Qi).  Let  a = l. 
Then  (x  - a)  = -Qi 
f(a)  = 0 

f’(x)  =1Tq: • f * (a)  = -1 


(A,  1 ) 


f"(x)  = 


(l  -Qi)' 


f"(a)  = 1 


f~(x)  = — T-.  f"’(a)  = -2 

(1  -Qi)3 

Equation  (A.l)  becomes « 


f(x)  = 0 ♦ (-1)(-Qi)  ♦ 

« l 

*9i*-f+Tf* 


9? 

+ T* 


^ # I 


L -r 

.1=1  3 


K K oo  Q3 

Thus,  S = ^-Ind-Qi)  = ^ Zx  -J 

Dropping  terms  of  order  three  and  higher , 

« 2 . 


K r 

S«  = lQi  ♦ 2 


(A. 2) 


(A. 3) 


(A. 4) 
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APPENDIX  B 


AN  UNBIASED  ESTIMATOR  FOR  T, 


Let  T^  = . An  unbiased  estimator  T^  is  desired 


for  T^  which  is  of  the  form 


A a 

Ti  ■ Vi  - f «i 


(B.l) 


A Fi 

where  Q.  ='«*■  . The  number  of  failures  of  ith  component  F. 

X IN  ^ 

is  a binomial  (N  = N^,  p = Qi)  random  variable  with  mean 
and  variance  N^Q^(l-Q^),  Thus, 


5(9^  = ^ E(Fi)  = 9. 


A 1 QiU-Q:) 

Yar(Q.  ) = 4?  Var(F.)  = — ^ — 

1 N?  1 i 

E(Q2)  = Var(Qi)  ♦ (E(Q._))2 

(2 


Qi(1-Qj) 
. Ni 


♦ q: 


«i  - af  ♦ Niai 

N. 


(3.2) 

(B.3) 

(3.4) 


Substituting 


B. 


E^)  = AjEU^  4E(q2) 


B^  Bi  Qi 

= (Ai  + 2N^Qi  * (3i  " n4  2 


That  T^  is  unbiased  implies 


(B.5) 


E(T.)  = T.  = Qa  ♦ 


(B.6) 
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Equating  coefficients  with  equation  (B.5) 


Bi 

Ai  + 2HJ  * 1 


B 


i 


(B.7) 

(B.8) 


Solving  the  above  two  equations  simultaneously  gives  the 

desired  expressions  for  and 

2N.  - 3 
Ai  = 2Ni  - 2 

Ni 

Bi  = NTT  1 (3.10) 
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APPENDIX  C 


DERIVATION  OF  THE  ACTUAL  VARIANCE  OF  ^ 

AND  COMPARISON  WITH  £ 

i=l^i 

Ti 

Reference  1 used  r-  as  a variance  estimate  for  T.. 

x 1 


Then  for  the  method  of  moments  gamma  fit, 

a K a K T, 

Var(S)  = I Var(T, ) « I 

i=l  1 i=l  wi 


(C.l) 


The  following  is  a derivation  of  the  actual  variance 

A 

of  T^,  and  then  a comparison  with  the  above  estimator. 

Since  Tj  = A.Q._  + \ (C.2) 

3? 

then  YarCTj^)  = A?Var(Qi)  ♦ AjB^OVCQ^Q2)  + -jivar(Q2)  (C.3) 

a r. 

where  • The  total  number  of  failures  on  the  ith 

component  F^,  is  a binomial  (N  = N^,  p = Q^)  random  variable, 
Then  A , 

E(Qi)  = 1TE(Fi)  = Qi  (c.4) 


a i Qi (1  - Qz ) 

Var(Qi)  = Var(Fi)  = -±- -1- 


n: 


N, 


(c.5) 


E(q| ) = VarfQ^  ♦ (E^))2 

91-Q!  ,a2 

N.  + wi 


and  C0V(QifQ2)  = E(q|) -E(Qi)E(Q2) 


(C.6) 

(C.7) 
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To  solve  equation  (C.7)f  E(Q?)  = must  be  solved. 

1 Nf  1 


Model  I = 
in 


1 

0 

N4 


if  the  in'1'11  test  fails 

if  the  m1'11  test  does  not  fail 


and  let  F,  = E I 
1 m=l  m 

3 ( Ni  \3 

Then  Ff  = E I 
1 \m=l 


E E E j I I 
j k 1 xk 


(C.8) 


(C.9) 


and  E(F?)  = j=J=1  E(I^)  ♦ EL  E(I*j)E(Ik)  + 


(all  three  equal)  (two  the  same  and 

one  distinct) 


E E E 


EdjEdjEdj 


j k 1 ' r ' k'  ^l' 

(all  three  distinct) 


(C.10) 


= N-Q^  3Ni(Ni  - 1)Q?  ♦ Ni(Ni  - l)(Ni  - 2)Q? 


This  implies  E(Q?)  = E(F h 

1 1 

= ^ f~Qi  -»•  3(Ni-l)Q^  ♦ (Ni-l)(Ni-2)Q^ 

Ni  L 

Now,  using  equation  (C.7)* 

C0Y(QifQ2)  , 2i|i  + (2Ni-3)Qi-2(Ni-l)Q?|  (C.ll) 

All  that  remains  unknown  in  equation  (C.3)  is  Var(Qp. 
Var(Q?)  = E(Q^)  - (E(q|) )2 


1 

N1 


-j  E(F^)  * ♦ Q 


Q . Q2  1 ^ 

-j— * q2 

N,  * '■‘i 


(C. 12) 
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Using  the  same  model  as  before, 

E(Ei>  - + 3 \ E(I3>  * 3 £ Ed^EU^) 

(all  indexes  (indexes  equal  (three  indexes  the 

equal)  in  pairs)  same  and  one  distinct) 

+ 3 £lE<Ij)  E(Ik)E(Il> 


(two  indexes  the  same  and  two  distinct) 

+ 3 £ l £n  E(Ij>  E(Ik>  E«l>  E<W 
(all  four  indexes  distinct) 


(C.13) 


= NiQi>  3Ni(Ni  - 1)Q?+  4Ni(Ni  - 1)QJ  ♦ 61^(1^  - 1 ) ( N±  - 2)Q  \ 


♦ Ni(Ni  - l)(Ni  - 2)(Ni  - 3)Q? 


Equation  (C.13)  is  used  to  find 


E(Sj)  = p-  S Q±  -»■  7(NJ>  - 1)Q*  + 6(Ni  - 1)  (^  - 2)Q? 


♦ (Ni-l)(Ni-2)(Ni-3)Qi 


(C.14) 


Substituting  equation  (C.14)  into  equation  (C.12), 


Var(Q^)  = -iJ  1+  (6Ni-7)Qi^4(Ni-l)(Ni-3)Qf 


- 2(Ni-l)(2Ni-3)Q^ 


(C.15) 


The  final  result  can  now  be  obtained  by  substituting  equa- 
tions (C.15)»  (C.ll),  and  (C.5)  into  equation  (C,3)»  yielding 


•«  • 


Q«  r 


VBLr(TL)  =ir(Qi  + AiBi“2  1+  (2Ni  - 3)Qi  - 2(Ni  - 1)Q? 

i Nj_  L J 


B?  Q. 

♦ Tf  1 + (6Ni-7)Q.f  |4(N.-l)(Ni-3) 


- 2(N±  - l)(2Ni  - 3)Q£ 


(C. 16) 


The  cumbersome  expression  above  can  be  greatly  simplified 
by  dropping  terms  with  divisors  of  N?  and  higher,  yielding 


q.  r o~\ 

Var(T.)  « nf  ' (1 -Qi)(Ai-^  BiQi)2  j 
i i-  j 


(C.17) 


A r A A o ! A Fi 

Then  Vardj)  | (1 -Qi)(Ai-»-BiQi)<:j  where  Q.  = jji  (C.lS) 


a 2n 


XN 


A comparison  was  made  between  Var(T^)  as  given  by  equation 
(C.18),  and  that  used  by  Ref.  1.  The  results  are  listed 
for  = 10,  20,  and  50  in  Table  XV.  The  simplistic  esti- 


A 

K T. 


mator  £ tj-  turns  out  to  be  an  excellent  approximation 
i=lNi 

K 


for  Var(S)  = £ Var(T. ), 

i=l  1 
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TABLE  XV 

A 

Actual  Variance  of  Compared  to  Estimate 
(One  Failure  Per  Component) 

~ ~ K ~ I K 5.  “ “ Z 

FAILURES  Var(S)=  Z Var(S)=  L «*(  1 - Q. ) (A.+B.Q.  )2 

i=lwi  i=lwi  1 1 1 1 


1 

Nj=10 

.01000 

.01003 

20 

.00250 

.00250 

50 

.00040 

.00040 

2 

0 

rt 

II 

T-l 

2 

.02235 

.02242 

20 

. Q0527 

.00527 

50 

.00082 

.00082 

3 

N1=10 

.03469 

.03480 

20 

. 00804 

.00805 

50 

.00123 

.00123 

4 

Nx=10 

.05032 

.05050 

20 

.01113 

.01113 

50 

.0016? 

.00167 

5 

1^=10 

. 06594 

.06619 

20 

.01421 

.014 22 

50 

.00210 

.00210 

6 

^=10 

.08635 

.08672 

20 

.01767 

.01769 

50 

.00255 

.00255 

7 

^=10 

.10676 

.10725 

20 

.02113 

.02115 

50 

.00301 

.00301 

8 

N1=10 

.13454 

.13526 

20 

.02504 

.02506 

50 

.00348 

. 00348 

9 

N1=10 

.16231 

.16327 

20 

.02895 

.02897 

50 

.00395 

.00395 

10 

1^*10 

.20231 

.20377 

20 

.03339 

.03342 

50 

. 00445 

.00445 
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APPENDIX  D 


DERIVATION  OP  THE  ZERO  FAILURE  CASE 
FOR  THE  MODIFIED  LIEBERMAN-ROSS  METHOD 


The  variables  U and  I are  undefined  when  no  failures 
occur.  Consider  type  III  censoring  in  which  N components 
are  placed  on  simultaneous  test,  with  replacement,  until  a 
pre-selected  time  TQ  [Ref.  8,  p.  238] . Type  III  censoring 
is  a component  LCL  procedure,  and  not  a system  LCL  procedure. 
Now,  consider  the  Modified  Lieberman-Ross  (MLR)  procedure 
where  items  of  the  ith  component  have  been  tested  with  no 
failures,  i = l,2,...,K.  If  the  are  identical  (as  is  the 
case  in  this  study  for  zero  failures),  then  the  above  is 
equivalent  to  testing  N\  "systems"  with  no  failures  until 
T0  = 1 "system"  mission. 

The  type  III  100(1 -a)#  LCL  on  the  mission  probability  of 
success  p of  a component  is 

Pl(cl)  = Exp  (^T?02  ) (D,1) 


where  F is  the  observed  number  of  failures,  N is  the  number 
of  components  on  simultaneous  test,  and  TQ  is  the  preselect- 
ed test  time.  Then  for  F = 0,  2F+2  = 2 and 

2NTq  = 2N^  • 1 system  mission  unit  = 2N^ 

A 100(l-a)£  LCL  on  system  reliability  Rg  when  no  failures 


occur  is 


RS,L(o)  - Ex» 


(D.2) 


for  equal,  i=l,2,...,K.  If  the  are  not  equal,  the 
minimum  should  be  used. 
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APPENDIX  E 


USE  OF  THE  PROBABILITY  INTEGRAL  TRANSFORM  (PIT)  IN 
GENERATING  EXPONENTIAL  AND  WEI BULL  FAILURE  DATA 

Assume  an  exponential  failure  process  for  the  ith  com- 
ponent with  rate  per  mission  unit.  Then  the  reliability 
of  the  ith  component  for  completing  one  mission  unit  isi 

Ri(l)  = Expt-X^  .1)  (F.l) 

Utilizing  the  PIT  method,  draw  a uniform  (0,1)  random  num- 
ber, denoted  "U",  and  form  the  equality » 

U = Exp (-Xjt) 

Solving  for  time-to-failure  t 
ln(U)  = -Xjt 
It  follows  that i 


t = -w 
1 


(F.2) 

(F.3) 

(F.4) 


The  computer  program  uses  the  following  algorithmi 

1)  Generate  a uniform  (0,1)  random  variable 

2)  If  U = Exp(-X^t)  is  less  than  Exp(-X^  • 1),  then  t>l 
mission  unit,  and  a success  has  occurred.  Truncate  the 
time-on-test  for  that  component  trial  to  1. 

3)  Otherwise,  a failure  has  occurred  at  t = 

*i 

The  simulation  was  also  ran  under  a Weibull  failure 
process  for  sensitivity  analysis.  The  Weibull  (P,X)  densi- 
ty  function  is  fj(t)  . Exp(-lt6)  (P.5) 

and  hazard  function 

h(t)  = ext&_1 


t > o,x>  o,p  > 0 


(F.6) 
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Using  the  PIT  method  as  before,  draw  a uniform  (0,1) 
random  number  U and  set 

U = F(t) 

= Exp(-X>ite)  (P.7) 

thus  T = (" — (F,  8) 

l 

Comparing  equations  (F.4)  and  (F.8)  shows  that  if 

T = an  exponential  (k.)  compone'nt  failure  time, 

*i  1 

then  is  Weibull  (3,  >.^).  Thus,  to  perform  the  Weibull 

sensitivity  analysis,  only  the  above  change  needs  to  be 
made  to  the  simulation  algorithm  (Chapter  III). 

Taking  the  derivative  of  the  Weibull  hazard  function 
with  respect  to  time 

= ^O2  -e)tg~2  (F.9) 

Therefore,  any  0<3<1  yields  a decreasing  hazard  rate,  and 
any  3>1  gives  an  increasing  one.  Case  one  was  ran  with 
3 = .5  and  3»0»  Note  that  the  comparison  logic,  used  by 
the  simulation  algorithm  to  determine  if  a failure  has 
occurred,  reduces  to  the  original  expression.  The  number 
of  failures  is  then  the  same  as  before.  The  Weibull  results 
are  shown  in  Table  IV. 
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APPENDIX  F 


1 


DERIVATION  OP  THE  RANDOMIZED  LOG-GAMMA  METHOD 
The  technique  for  randomization  of  the  classical  bi- 
nomial model  is  a direct  application  of  Barr  and  Jayachand- 
ran's  1975  article  ^Ref,  7]  . It  can  be  applied  directly 
to  obtain  a system  reliability  LCL  when  a total  of  zero 
or  one  failure  occurs  among  all  component  tests,  because 
these  cases  translate  into  equivalent  system  failures  (see 
Figure  3t  p.  ^5). 

The  binomial  point  estimate  for  p is  p = X/N,  where  X is 
the  number  of  observed  successes  in  N trials.  The  classi- 
cal binomial  100{l-a)/5  LCL  for  p,  denoted  Pj^a)*  the 
solution  for  p in  the  equation 

^ ('i)  p3  (1  - p)N*3  = a (F.l) 

when  no  failures  occur,  or  X = N,  this  becomes 

Pi(«)  * °1/N  <p-2> 

and  for  one  failure,  PL(a)  is  the  solution  for  p in 

Np^l  -p)  + pN  = a (F.3) 

This  P^^j  Has  the  property  that  Pr  [pL(a)  < p]  > 1 - a 

Reference  7 develops  a method  of  randomizing  discrete 
LCL  procedures  which  are  conservative,  and  illustrates  it 
for  the  binomial  case.  The  exact  randomized  100(1  -a)# 
binomial  LCL  for  p is  developed  as  follows. 
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a.  The  number  of  observed  successes  X is  a binomial 
random  variable  with  probability  mass  function  B(x{N,p). 
Define  h(p)  as  the  smallest  integer  such  that 


Pr(X>  h(p) ) < a x 0,1 ,N  (F.4) 

Thus,  h(p)  denotes  an  observed  value  of  X, 
b.  Define 

ap  2 Pr(X > h(p) ) (F.5) 

and  y(p) 5 F_1|l  - (a  - ap)/B(h(p) jN,p)\  (F.6) 


where  F is  the  "randomizing"  distribution  function  of  Y. 
Reference  7 shows  that  F can  be  the  uniform  (0,1)  distribu- 
tion function  without  loss  of  generality.  Then  using 
equation  (F.5),  y(p)  can  be  simplified  to 

y(p)  = 1 - (a  - Pr(X>  h(p)  )/Pr(X=h(p) ) (F.7) 

Finally,  define 


L (x+  y)  * J 


g(p)  = h(p)  + y(p)  (F.8) 

* 

Then  the  exact  binomial  randomized  LCL  for  p,  L (x+y) 
is  given  by 

'(x+y)i  1 - a < x+y  < N+l-a 

0 j x+y  < 1 -a 

1,0  j x+y>N+l-a 

To  solve  for  L*(x+y),  form  the  equality 

g(p)  = X+Y  = h(p)  ♦ y(p)  (F.  10) 


(F,  9) 


Since  h(p)  is  an  observed  value  of  X,  this  reduces  to 

Y = y(p)  =1  - (a  - Pr(X>h(p) ) )/Pr(X  = h(p) ) (F.U) 
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By  solving  for  p and  applying  equation  (F.9) 

- ("  the  solution  for  p in 

L (x  + y)  = 

(1  - Y)Pr(X=x)  ♦ Pr(X>x)  = a 1-a  < x+y  < N*l-a 


0 

x+y  < 1 -a 

(F.12) 

1.0 

x+y  > N+l-a 

Thus,  for  no  failures,  or  X = 

N,  L*(x+y)  is  the 

solution 

for  p in 

(1 

-Y)pN  = a 

(F.13) 

A 

f a a/N 
(1  - YJ 

y < 1 - a 

or  PL(a)  = 

< 

(F.14) 

1.0 

y > 1 - a 

when  X = N - 1,  or 

one  failure. 

L (x+  y)  is  the 

solution  for 

p in 


(1  - Y)  Pr(X  =x)  ♦ Pr(X > x)  = a 
or  (1  - Y)  NpN-1  (1  - p)  ♦ pN  = a 


(F.15) 


When  two  or  more  failures  occur,  a component  LCL  pro- 
cedure such  as  L*(x+  y)  cannot  be  used.  The  original  Log- 
Gamma  procedure  can,  however,  be  "randomized"  as  follows. 
Draw  a uniform  (0,1)  random  number  for  each  type  of  compo- 
nent that  fails.  Denote  it  Yj^  for  the  ith  component,  and 
compute  the  "randomized"  number  of  failures 

P*  = ?L  - Yi  (F.16) 

where  F^  is  the  observed  number  of  failures  on  the  ith 
component. 


80 


The  Randomized  Log-Gamma  procedure  (RLG)  was  developed 
by  trial  and  error  via  computer  simulation,  using  the  above 
adjustments  where  most  effective.  It  can  be  stated  as 
follows i 

Randomized  Log-Gamma  Method 
a.  Zero  failures  in  all  components i 


A 

R 


S,L(a)  = 


' 1-Y  ' 


1/N, 


(P.17) 


y < 1 - a 

[ 1.0  y > 1 - a 

where  uniform  (0,1), 

b.  One  failure  among  all  components! 

A the  solution  for  p in 

‘ S,L( ct)  (l  . y)NiPNi_1(1 -p) +pNl  = a 

The  use  of  a1^1!  as  an  approximation  to  Rs  for  y>l-a, 

is  reasonably  accurate  for  low  N1  and  very  accurate  for 
large  as  shown  below. 


(F.18) 


TABLE  XVI 


Accuracy  of  the  Approximation  a 


1/Ni 


Y=  .9 
a = .2 

Actual  RSfL(a) 
a^l 


N = 10  20  50 

.837  .915  .965 

.851  .923  .968 


c.  Two  through  four  component  failures! 

For  each  different  type  of  component  that  had  at 
least  one  failure,  draw  a uniform  (0,1)  random  number. 
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Compute  Log-Gamma  method  with  exact  degrees  of  freedom  and 

* 

F^  instead  of  the  observed  number  of  failures  F^. 
d.  Five  or  more  failures! 

Use  the  Log-Gamma  method  with  exact  degrees  of 

freedom. 


APPENDIX  G 


AN  EXAMPLE  OF  THE  RANDOMIZED  LOG -GAMMA  PROCEDURE 
Let  N^  = 20,  K = 15»  and  a =,2,  Suppose  that  the  replica 
has  no  failures.  Then  a uniform  (0,1)  random  number  Y is 
generated;  say  Y = .5.  Then  since  Y < 1 - a. 


RS,L(.2) 


= = * 955 


as  opposed  to  the  classical  binomial  LCL  of  .923. 

Suppose  some  future  replica  had  one  failure  in  some 

A 

component,  and  Y=  .6  is  generated.  Then  Rs  2)  "the 
solution  for  p in  the  equation 


20p19(l-p)(l-,6)  + p20  = .2 

Therefore,  Rs  2)  = *892.  The  classical  binomial  LCL  is 


.858. 


Now,  suppose  another  replica  had  two  failures  in  the 

5th  component  and  one  failure  in  the  15th  component,  and 

* 

that  Y^  = .3  and  Y^  = .8  were  generated.  Thus,  F^  = 1.7  and 

* 

F^s.2.  Applying  the  LG  procedure,  N^  = 20,  » 19 


S = 


15 


= + T^  = .0969 


-4“ 


Ttr 


2r  = 3.853 
'2 


%.8,3. 


l^miL  . i ,926 


.0649 


853 


a 1.56 
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Then 

without 


RS,L(.2) 


-2rS 

7 2 f 

A.8,3.853  J 


.7  87 


randomization,  the  LCL  would  have  been 


RS,L(.2) 


.740 
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APPENDIX  H 


THE  COMPUTER  PROGRAM 

The  following  pages  list  the  computer  program  used  for 
the  simulations.  Flags  were  used  to  designate  the  portions 
of  the  program  to  be  executed,  depending  on  which  modifica- 
tions were  desired.  Proprietary  subroutines  [Ref,  9]  were 
utilized  for  inverse  chi  square  values  (MDCHI),  sorting 
the  approximate  distributions  of  Rg  L(a)»  (^SORTA),  gener- 
ation of  uniform  (0,1)  variates  ( GGUB ) , and  solving  for 
the  RLG  procedure  (ZREAL2).  The  APL  subroutines  HISTLI3T 
and  HIST  were  used  in  Table  X and  Figures  4 and  5 respec- 
tively [Ref,  lo]  . The  plotting  subroutine  PLOTP  was  used 
in  Tables  VII  and  VIII  [Ref.  ll]  . 

The  program  was  written  in  the  FORTRAN  IV  language  for 
use  on  the  IBM-36O  system  at  the  Naval  Postgraduate  School. 
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